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From whence the results came... 



This Box 
Intentionally Left 
Blank 


This Talk 
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Reputation 

• Belief about attribute 

• Hindsight, 
capabilities, statistics 

• Concern: adverse 
selection 
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Trust 

• Belief will not 
exploit 

• Foresight, strategy, 
game theory 

• Concern: moral 
hazard 
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• Humans are rational* 

*given limited computational bounds, 
unfounded beliefs of others, inaccurate 
capability assessments, inexplicable 
valuations, and some level of [im]patience 

• Valuations, capabilities, and patience can 
be measured! -► reputation 

• Model new situations -» trustworthiness 
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Discounting 

• Uncertain future 

• Delay on reward 

• Influenced by: patience, beliefs, 
risks, exogenous discount factors & 
value 

• Expected utility = 

• Exponential, dynamically consistent 

£ y< u 

• Hyperbolic, realistic hazard 
rate: £ l/(l+yt)u 


Perceived Utility 
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Discounting Everywhere 


Stochastic search 


N 


7r(a) = 


R t 


t;xp 


( ,: m / T ) 


EtMI.) ex p(73Sl/ r ) 


V(X 0 ) = max 

Wt=o 1 =0 


Amortization NPV(iJV)= S(i+i) 

Bellman Equation 
Reinforcement Learning 
Markov Decision Processes & POMDPs 

Q{s t ,at) <r- Q(s t ,a t ) + a[r t+ i+jQ(s t+ i,a t+ i) - Qfsf.cit)] 


***Normalize discount rate wrt time 
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Defining Comparable Trustworthiness 


Strength Comparison Stability 
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Trustworthiness Isomorphic to Discount Factor 

• Compare two agents interacting with third in pure 
moral hazard situation 

• Assumptions 

- Consistent valuations 

- Quasilinearity 

- Trustworthiness sufficiently consistent 
Individually rational 

• All else equal, given definitions & assumptions, only 
factor that affects trustworthiness is discount factor 


ECU) 
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Measuring discount factor by choice 
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Creeping Sniper' 




s Dilemma 


• Single sniper optima^sti;ategy; slow creep out = low risk 

_ w f 1 ~V 1 ~~ s i T 

— /si ) y ^ s i J 

• Multiple sniper optimal strategy 

♦ Match quickest visible discount strategy unless too risky 
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Negotiating 



• Rubenstein Negotiation 

• Vi = (1 -y 2 )/(1-YiY 2 ) 

• Inequalities if rationality not guaranteed 

• Player & NPC interaction inequalities 

• Impatience w » - "i - 1 < 7t < Wk - aT 

w b — a T w b - (j T +i 

• NPC disagreements with player over choices 
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Combining Observations: Bayesian Inference 
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Optimal Level of Patience for Given Scenario 
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Trust Exploration 

• Measure valuations, 
discount factor, 
beliefs, maxent 
regions 

• NPCs of different 
trustworthiness 

• Reputations 
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Trust Exploitation 

• Push player's ethics 
buttons: "what is 
your price?" 

• Stability & comfort vs 
conflict 

• Trickery 
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Psychological Heuristics of Trust 

Homophily 


Embedding 


Corroboration 
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Trust & Society 



• Enforcing/sanctioning to combat lies 

• Incentive compatibility & revelation principle wrt 
information asymmetry 

• Level of trust req'd for system & efficiency 

• Too trusting with homophily, embedding, 
corroboration? 

• Common inability to play "red player" 
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Direct Applications (Conclusions) 



• NPC decisions: favors, purchases, alliances 

• Measuring player patience 

• Adversary willingness to look ahead related 
to organizational trust (e.g., big bad) 

• NPC subordinates following player commands 
based on trustworthiness (explicit or implicit) 
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For further info 



hazardoussoftware.com 

cjhazard@hazardoussoftware.com 


